Method of controlling a garment to record activity data

ABSTRACT

The method comprises receiving a representation of a visual symbol, wherein the visual symbol comprises a code string identifying the garment that is encoded into the visual symbol (101). The method comprises establishing, based on the representation of the visual symbol, the identity of the garment (102). The method comprises transmitting, to the identified garment, an authorisation code to activate a sensor of the garment to record activity data (103).

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims priority from United Kingdom Patent Applicationnumber 1908187.6 filed on 7 Jun. 2019, the whole contents of which areincorporated herein by reference.

BACKGROUND

The present invention is directed towards a method, garment and system.The present invention is directed in particular towards controlling asensor incorporated into the garment to record activity data.

Garments incorporating sensors are wearable electronics designed tointerface with a wearer of the garment, and to determine informationsuch as the wearer's heart rate, rate of respiration, activity level,and body positioning. Such properties can be measured via skin contactwith a sensor assembly that includes a sensor for signal transductionand/or microprocessors for analysis. Such garments are commonly referredto as ‘smart clothing’.

It would be desirable to provide a mechanism for controlling a sensorincorporated into the garment to record activity data.

SUMMARY

According to the present disclosure there is provided a method, garmentand system as set forth in the appended claims. Other features of theinvention will be apparent from the dependent claims, and thedescription which follows.

According to a first aspect of the invention, there is provided method.The method comprises receiving a representation of a visual symbol of agarment. The visual symbol comprises a code string identifying thegarment that is encoded into the visual symbol. The method comprisesestablishing, based on the representation of the visual symbol, theidentity of the garment. The method comprises transmitting, to theidentified garment, an authorisation code to activate a sensor of thegarment to record activity data.

Significantly, a garment comprising a marker is provided. The markercomprises a (unique) code string identifying the garment encoded into avisual symbol. When the visual symbol is imaged and the data string isobtained from the image, the data string is used to activate a sensor ofthe garment to record activity data. In this way, the sensor of thegarment may be controlled to record activity data via the process ofimaging the garment and processing the resultant image.

The method therefore enables the sensor of the garment to be controlledusing a simple electronic device such as a portable electronic devicewith an integrated camera Beneficially, the sensor of the garment iscontrolled through a simple and intuitive procedure of imaging thegarment. This approach enables a user to control when the sensor of thegarment records activity data. This may be beneficial in reducing thepower consumption of the garment such that the sensor is only activatedto record activity data at user desired times. The visual symbol may belocated on an outside surface or otherwise readable from the outsidesurface of the garment so that it may easily be read by the electronicdevice.

The representation of the visual symbol may be a data stringrepresenting the visual symbol.

Establishing, based on the data string, the identity of the garment maycomprise decoding the data string so as to obtain the code string andmay further comprise identifying the garment based on the code string.The data string may be a simple digitised representation of the visualsymbol or may be an encrypted version of the code string. The method mayrun a decoding algorithm to generate the code string from the datastring.

A database may be provided which may store one or a plurality of codestrings each associated with a different garment. The identity of thegarment may be established based on which of the code strings in thedatabase the generated data string (once decoded) matches.

The method may further comprise obtaining a user credential from a user.The sensor may only be activated to record activity data if the user isauthorised, based on the obtained user credential, as having permissionto access the activity data.

The method may further comprise receiving a user credential. The methodmay further comprise establishing, based on the user credential, whetherthe user is authorised to activate the sensor. The method may furthercomprise transmitting the authorisation code to the identified garmentonly if the user is authorised to activate the sensor.

The user credential may be in the form of a password or passcode. Theuser credential may be in the form of biometric data. Different usersmay have different permissions levels and thus may have permission toaccess different sensors on the garment or to access different recordingoperations performed by the sensor. For example, a sensor may be able torecord a plurality of different types of biodata, but a user may onlyhave permission to activate the sensor to record one or a subset ofthose types of biodata. The method may comprise determining, from theuser credential, the permission level of the user, and may compriseactivating the sensor based on the determined permission level.

Receiving the representation of the visual symbol may comprise:obtaining an image of the garment; and processing the image to generatethe representation of the visual symbol.

The visual symbol may be part of a fiducial marker of the garment. Thefiducial marker may be located on the outside surface of the garment ormay be otherwise readable from the outside surface of the garment. Themethod may further comprise processing the image to determine thelocation of the fiducial marker.

Beneficially, a fiducial marker is useable as a point of reference forthe garment and thus enables the position of the garment and the motionof the garment over time to be monitored simply by capturing images ofthe garment. In this way, a single marker on the garment is not onlyused to identify the garment but also beneficially allows for the motionof the garment to be monitored. The fiducial marker may be in the formof a 2D image. The fiducial marker of the present invention isbeneficial as it is simple, of low cost and does not negatively affectthe comfort of the garment for the wearer. The fiducial marker may be anaugmented reality (AR) marker with additional information in the form ofthe code string encoded therein.

The fiducial marker may have a limited visual footprint on the garment.This means that the fiducial marker may be sufficiently small that it isnot easily visible by the naked eye but is still visible in the capturedimage. In this way, the fiducial marker does not affect or has a minimaleffect on the appearance of the garment. In some examples, the fiducialmarker is visible to the naked eye.

The method may further comprise receiving the recorded activity datafrom the garment.

The method may further comprise displaying a representation of thereceived activity data on a display.

The method may further comprise simultaneously displaying arepresentation of a wearer of the garment with the representation of theactivity data on the display.

The position of the representation of the activity data on the displaymay be determined according to the determined location of the fiducialmarker.

The position of the representation of the activity data may bedetermined by applying a predetermined displacement to the coordinatelocation of the fiducial marker.

The position of the representation of the activity data may correspondto the position of a feature of interest on a wearer of the garment.

The method may further comprise simultaneously displaying arepresentation of a wearer of the garment with the representation of theactivity data on the display.

The representation of the activity data may at least partially overlaythe displayed representation of the wearer. Beneficially, the display ofthe activity data is enhanced by positioning the activity data over therepresentation of the wearer so that the user can understand therelationship between the activity data and a relevant physiologicalcomponent of the wearer.

Displaying the representation of the wearer of the garment may comprisedisplaying the obtained image. The obtained image may be a live viewimage. That is, a real-time video otherwise known as a live video feed.That is the camera may capture live view image data which may then bedisplayed on the display of the apparatus performing the method. Theuser may therefore view a live view image of the wearer.

Displaying the representation of the wearer of the garment may comprisedisplaying an avatar representation of the wearer, optionally whereinthe avatar representation of the wearer is a 3D representation of thewearer. The avatar may be animated to mimic the motion of the wearer.The avatar may be animated based on motion data obtained from one ormore motion sensors of the garment.

The representation of the activity data may be in the form of anaugmented reality object.

The representation of the activity data may represent a physiologicalstate of the wearer. The physiological state may relate to a muscle ormuscle group of the wearer, an organ of the wearer such as the heart orlung(s), or a condition such as the wearer's hydration level.

The activity data may comprise activity data related to a muscle ormuscle group of a wearer of the garment. The position of therepresentation of the activity data may be determined to correspond toan estimated location of the muscle or muscle group of the wearer asdetermined from the location of the fiducial marker. The method maycomprise simultaneously displaying a representation of the wearer withthe representation of the activity data. The representation of theactivity data may be displayed such that it overlays the representationof the wearer at the position corresponding to the estimated location ofthe muscle or muscle group of the wearer.

The muscle or muscle groups may comprise one or more of the triceps,deltoids, pectorals, abdominals, quadriceps, hamstrings, gluteals, andforearms.

The representation of the activity data may represent a physiologicalstate of the muscle or muscle group such as whether the muscle or musclegroup are in contraction or relaxation. The representation of theactivity data may convey information relating to the activity level ofthe muscle or muscle group such that the representation may have adarker or lighter colour depending on the intensity of the activityperformed by the user.

The activity data may comprise cardiac activity data. The position ofthe representation of the activity data may be determined to correspondto an estimated location of the heart of a wearer of the garment asdetermined from the location of the fiducial marker. The method maycomprise simultaneously displaying a representation of the wearer withthe representation of the activity data. The representation of theactivity data may be displayed such that it overlays the representationof the wearer at the position corresponding to the estimated location ofthe heart of the wearer.

The representation of the activity data may represent a physiologicalstate of the heart such as the heart rate.

The representation of the activity data may be in the form of anaugmented reality object.

The representation of the activity data may be in the form of a 2D or 3Dobject of a feature of interest of the wearer such as a muscle, musclegroup or organ. The object may be in the form of a 2D or 3D model of aheart. The model of the heart may be animated to beat at a ratecorresponding to the heart rate of the wearer as determined from theactivity data.

The obtained image may be captured by a camera. The camera may capture alive view image. Obtaining the image may therefore comprise capturingthe image by a camera. The camera may be part of an apparatus performingthe method or may be communicatively coupled to the apparatus.

The method may be performed by a server or other electronic apparatussuch as a user electronic device. In some examples, the method isperformed by a server in communication with a user electronic device. Asa result, an electronic device which may not be in direct communicationwith the garment is able to control the recording of activity data bythe sensor.

According to a second aspect of the invention, there is provided anapparatus arranged to perform the method of the first aspect of theinvention. The apparatus may be a user electronic device or a server.

According to a third aspect of the invention, there is provided agarment. The garment comprises a sensor. The garment comprises acommunication unit. The garment comprises at least one marker, the atleast one marker comprising a code string identifying the garmentencoded into a visual symbol. The communication unit is arranged toreceive an authorisation code, the authorisation code being generatedaccording to the at least one marker. The sensor is arranged to beactivated to record activity data according to the authorisation codereceived by the communication unit.

The communication unit may be arranged to receive activity data for thewearer from the sensor and transmit the activity data to an externaldevice. The at least one marker may be a fiducial marker.

The sensor may be able to record a plurality of different types ofactivity data. The sensor may be arranged to be activated to record allor a subset of the types of activity data according to the receivedauthorisation code.

The garment may comprise a plurality of sensors, and one or more of thesensors are activated according to the authorisation code received bythe communication unit.

The at least one marker may be located on an outside surface of thegarment.

The garment may be suitable for the method of the first aspect of theinvention.

The marker may be a 2D image. The marker may be a fiducial markeroptionally in the form of a 2D image. The marker may be an AugmentedReality (AR) marker with additional information in the form of the codestring encoded therein.

The marker may comprise a plurality of markers. The plurality of markersmay be located at different locations on the garment. The plurality ofmarkers may be arranged in a geometric pattern. The plurality of markersmay be arranged together on the garment to form a decorative item.

The plurality of markers may be located at different locations on thegarment.

The marker may be integrated into the garment.

The marker may be printed onto the garment. Any known garment printingtechnique may be used such as screen printing or inkjet printing. Themarker may be incorporated onto the garment using a direct to garmentprinting technique.

The marker may be incorporated into the stitching of the garment, and/ora seam of the garment, and/or a hem of the garment, and/or a neckline ofthe garment, and/or a collar of the garment, and/or a sleeve of thegarment, and/or a cuff of the garment, and/or a pocket of the garment,and/or a body of the garment, and/or a fastener of the garment. Thefastener may be a zipper, button, clasp, toggle, stud, snap fastener,popper, eyelet, buckle, tie or ribbon.

The sensor may comprise a plurality of sensors.

The sensor may be arranged to sense one or more signals external to thewearer. The sensor may be any or a combination of a temperature sensor,a camera, a location tracking module such as a GPS module, and achemical sensor.

The sensor may be a biosensor arranged to measure one or more biosignalsof a user wearing the wearable article. Here, “biosignal” may refer toany signal in a living being that can be measured and monitored. Theterm “biosignal” is not limited to electrical signals and can refer toother forms of non-electrical biosignals. The biosensor may be used formeasuring one or a combination of bioelectrical, bioimpedance,biochemical, biomechanical, bioacoustics, biooptical or biothermalsignals of the wearer. The bioelectrical measurements includeelectrocardiograms (ECG), electrogastrograms (EGG),electroencephalograms (EEG), and electromyography (EMG). Thebioimpedance measurements include plethysmography (e.g., forrespiration), body composition (e.g., hydration, fat, etc.), andelectroimpedance tomography (EIT). The biomagnetic measurements includemagnetoneurograms (MNG), magnetoencephalography (MEG), magnetogastrogram(MGG), magnetocardiogram (MCG). The biochemical measurements includeglucose/lactose measurements which may be performed using chemicalanalysis of the wearer's sweat. The biomechanical measurements includeblood pressure. The bioacoustics measurements include phonocardiograms(PCG). The biooptical measurements include orthopantomogram (OPG). Thebiothermal measurements include skin temperature and core bodytemperature measurements. The biosensor may comprise a radar unit. Thegarment may sense a combination of external signals and biosignals ofthe wearer.

In some examples, the marker has a limited visual footprint on thegarment. This means that the marker is sufficiently small that it is noteasily visible by the naked eye but is still visible in the imagecaptured by the image capturing device. In this way, the marker does notaffect or has a minimal effect on the appearance of the garment. In someexamples, the marker is visible to the naked eye.

The marker may be incorporated into or form part of visual element onthe garment which may be a decorative item in the garment. Thedecorative item may be a logo, design, image or pattern on the garment.In this way, the marker may contribute to or enhance the appearance ofthe garment.

The garment may refer to an item of clothing or apparel. The garment maybe a top. The top may be a shirt, t-shirt, blouse, sweater, jacket/coat,or vest. The garment may be a dress, brassiere, shorts, pants, arm orleg sleeve, vest, jacket/coat, glove, armband, underwear, headband,hat/cap, collar, wristband, stocking, sock, or shoe, athletic clothing,personal protection equipment, swimwear, wetsuit or drysuit. The garmentmay be constructed from a woven or a non-woven material.

The garment may be constructed from natural fibres, synthetic fibres, ora natural fibre blended with one or more other materials which can benatural or synthetic. The yarn may be cotton. The cotton may be blendedwith polyester and/or viscose and/or polyamide according to theparticular application. Silk may also be used as the natural fibre.Cellulose, wool, hemp and jute are also natural fibres that may be usedin the garment. Polyester, polycotton, nylon and viscose are syntheticfibres that may be used in the garment.

The garment may be a tight-fitting garment. Beneficially, atight-fitting garment helps ensure that any sensors of the garment areheld in contact with or in the proximity of a skin surface of thewearer. The garment may be a compression garment. The garment may be anathletic garment such as an elastomeric athletic garment.

The garment may be a shirt. The marker may be located on the collar,yoke, sleeve, gauntlet, cuff, body, pocket, plackett, or fastener of theshirt. The shirt may comprise a plurality of markers. The plurality ofmarkers may be located at a plurality of different positions on theshirt. The plurality of different positions on the shirt may compriseone or more of the collar, yoke, sleeve, gauntlet, cuff, body, pocket,plackett, or fastener of the shirt

The garment may be a T-shirt. The marker may be located on the neckline,sleeve, cuff, body or hem of the T-shirt. The T-shirt may comprise aplurality of markers. The plurality of markers may be located at aplurality of different positions on the T-shirt. The plurality ofdifferent positions on the shirt may comprise one or more of theneckline, sleeve, cuff, body or hem of the T-shirt.

The communication unit may be a mobile/cellular communicator operable tocommunicate the data wirelessly via one or more base stations. Thecommunication unit may provide wireless communication capabilities forthe garment and enables the garment to communicate via one or morewireless communication protocols such as used for communication over: awireless wide area network (WWAN), a wireless metroarea network (WMAN),a wireless local area network (WLAN), a wireless personal area network(WPAN), Bluetooth® Low Energy, Bluetooth® Mesh, Bluetooth® 5, Thread,Zigbee, IEEE 802.15.4, Ant, a near field communication (NFC), a GlobalNavigation Satellite System (GNSS), a cellular communication network, orany other electromagnetic RF communication protocol. The cellularcommunication network may be a fourth generation (4G) LTE, LTE Advanced(LTE-A), LTE Cat-M1, LTE Cat-M2, NB-IoT, fifth generation (5G), sixthgeneration (6G), and/or any other present or future developed cellularwireless network. A plurality of communication units may be provided forcommunicating over a combination of different communication protocols.

According to a fourth aspect of the invention, there is provided asystem comprising a garment of the third aspect of the invention and anapparatus according to the second aspect of the invention. The apparatusmay comprise one or more electronic devices may be operable to performthe method of the first aspect of the invention. The one or moreelectronic devices may be operable to: obtain an image of the garment;process the image to generate a representation of the visual symbol; andtransmit the representation of the visual symbol to a server so as toactivate a sensor of the garment identified by the code string to recordactivity data.

According to a fifth aspect of the invention, there is provided acomputer program comprising instructions which, when the program isexecuted by a computer, cause the computer to carry out the method ofthe first aspect of the invention.

According to a sixth aspect of the invention, there is provided acomputer readable storage medium comprising instructions which, whenexecuted by a computer, cause the computer to carry out the method ofthe first aspect of the invention.

There is also provided a method of manufacturing a garment according tothe third aspect of the invention. The method comprises generating acode string using a random number generator; encoding the code stringinto a visual symbol; and incorporating the visual symbol onto thegarment.

According to a seventh aspect of the invention, there is provided methodperformed by a system comprising a server and a user electronic device.The method comprises the user electronic device obtaining an image of agarment, wherein the garment comprises a visual symbol. The visualsymbol comprises a code string identifying the garment that is encodedinto the visual symbol. The method comprises processing the image togenerate a representation of the visual symbol. The method comprisestransmitting the representation of the visual symbol to the server. Themethod comprises the server receiving, from the user electronic device,the representation of a visual symbol. The method comprisesestablishing, based on the representation of the visual symbol, theidentity of the garment. The method comprises transmitting, to theidentified garment, an authorisation code to activate a sensor of thegarment to record activity data. The transmitting may be performed bythe server or the user electronic device. The server may transmit theauthorisation code indirectly via the user electronic device. The visualsymbol may be located on an outside surface of the garment.

The system may also comprise the garment.

BRIEF DESCRIPTION OF THE DRAWINGS

Examples of the present disclosure will now be described with referenceto the accompanying drawings, in which:

FIG. 1 shows a flow diagram for an example method according to aspectsof the present invention;

FIG. 2 shows a flow diagram for an example method according to aspectsof the present invention;

FIGS. 3A and 3B show example markers in accordance with aspects of thepresent invention;

FIG. 4 shows an example system according to aspects of the presentinvention;

FIG. 5 shows an example user interface according to aspects of thepresent invention;

FIG. 6 shows an example user interface according to aspects of thepresent invention;

FIG. 7 shows an example user interface according to aspects of thepresent invention; and

FIG. 8 shows an example user interface according to aspects of thepresent invention.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thedisclosure. In addition, descriptions of well-known functions andconstructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of thedisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of thedisclosure is provided for illustration purpose only and not for thepurpose of limiting the disclosure as defined by the appended claims andtheir equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.

According to aspects of the present invention, a garment is providedhaving a marker located on an outside surface of the garment. The markercomprises a code string identifying the garment encoded into a visualsymbol. In more detail, a code is generated for the garment using arandom number generator. The code may in a code format with sufficientaddress space to enable a sufficient number of different codes to begenerated. For example, the code format may be in the form of a14-character hexadecimal number. Once the code is generated by therandom number generator, a processor running an algorithm converts thecode into a visual symbol which is printed or otherwise manufacturedonto the garment. Encoding the code into a visual symbol is beneficialbecause the original code cannot be parsed from the visual symbolwithout access to the encoding algorithm. Moreover, the visual symbol iseasily machine readable by providing image data of the visual symbolcaptured using a camera. As an added benefit the visual symbol is alsouseable as a fiducial marker for tracking the motion of the garment.

The garment further comprises a sensor or more typically a plurality ofsensors. The activity data obtained by the sensors is transmitted by acommunication unit of the garment to a server. The transmission may beperformed over a high throughput wireless communication protocol such as5G.

The garment may be worn by a first person referred to as the “wearer”. Asecond person referred to as the “user” is in possession of a userelectronic device such as a mobile phone. The second person may desireto see activity data for the wearer as recorded by the sensors of thegarment. For example, the user may be a personal trainer that may desireto view metrics such as the wearer's heartrate, respiration levels andhydration levels. The user may also be a healthcare professional such asa physiotherapist or doctor.

In some examples, the “user” and the “wearer” refer to the same person.For example, the user electronic device may be a television apparatuswith an integrated camera. The wearer of the garment may stand in frontof the television apparatus and may be captured by the camera of thetelevision apparatus. The television apparatus may then display theactivity data so that the wearer may view their activity information.

Referring to FIG. 1, there is shown an example method according to thefirst aspect of the present invention that allows the user of to controla sensor of the garment to record activity data. The method is performedby a server in communication with a user electronic device. In someexamples, the server and the user electronic device may be the samedevice.

In step 101 of the method, the server receives, from the user electronicdevice, a representation of a visual symbol located on an outsidesurface of a garment. The visual symbol comprises a code stringidentifying the garment that is encoded into the visual symbol. Therepresentation of the visual symbol may be a data string. The visualsymbol may be converted into the data string by the user electronicdevice performing an image processing operation. The user electronicdevice may generate the data string by simply digitising the image ofthe visual symbol. The digitised version of the visual symbol may thenbe transmitted to a server which decodes the symbol. Alternatively, theuser electronic device may translate the visual symbol into an encryptedversion of the code string. The encrypted version of the code string maybe transmitted by a server for decoding. The user electronic device maydecode the data string but it is generally beneficial to keep thedecoding algorithm private.

In step 102 of the method, the server establishes, based on therepresentation of the visual symbol, the identity of the garment. Inmore detail, the server may decode the data string and compare thedecoded data string to the original code string (which may be storedsecurely on the server) to determine whether the decoded data stringmatches the code string. The server may store code strings for a numberof garments and therefore the decoded data string may be comparedagainst a plurality of code strings stored in the database. If thedecoded data string matches a code string in the database, the servermay identify the garment associated with the code string and maygenerate an authorisation code for activating a sensor of the garment torecord activity data. The activity data may be transmitted to theserver, the user electronic device, or to another server that iscommunicatively coupled to the server.

In some examples, the plurality of code strings stored in the databasemay relate to garments with sensors that are authorised to record data.If a garment is stolen, for example, the owner may report the theft tothe service provider. The service provider may then remove the codestring associated with the garment from the database or flag the codestring to identify that the garment has been stolen and is no longerauthorised to record data. Then, when the server subsequently attemptsto establish the identity of the garment, the authorisation process willfail and the authorisation code for activating the sensor of the garmentwill not be generated and transmitted to the garment. In this way, thesensor is not activated and the functionality of the garment isrestricted.

In some examples, the authorisation code may only be generated if thegarment is associated with a user that has paid for or has the requiredpermission to use the sensor. The sensor may be a “premium” sensor thatis only available with certain payment plans. The method enables theselective activation of these sensors such that different levels ofactivation of the garment may be provided depending on the servicesrequired by the end user. In some examples, the user electronic devicemay also obtain a user credentials for the user. The user credential maybe in the form of a password or passcode or biometric data. Any form ofbiometric data may be used such as fingerprint data, ECG data, or irisdata. The user electronic device transmits the data string and the usercredential to the server. The server then identifies the garment fromthe data string and authenticates the user based on the user credential.In more detail, the server may store the code string associated with theidentified garment and the user credential indicating whether the useris authorised to access the activity data. This information may bestored in a database along with code strings for other garments and usercredentials for other users. In response to receiving the data stringand the user credential, the server decodes the data string and comparesthe decoded data string to the code string or strings in the database.

If the decided data string matches a code string in the database, theserver identifies the garment associated with the code string. Theserver then determines based on the received user credential whether theuser is authenticated as having permission to access the activity data.Different users may have access to different sensors or types of biodatarecorded by the sensors. That is, different users may have differentpermission levels in relation to controlling the sensors of the garment.For example, a personal trainer may be able to activate the sensors torecord a limited amount of activity data for the garment. The personaltrainer may be able, for example, to record heart rate, respirationrate, and hydration level data. The personal trainer may not be able torecord other activity data which may relate to more personalinformation. In contrast, a healthcare professional may be able torecord all of the data for the garment. The access level may beindicated by the user credential.

It will be appreciated that the step of obtaining user credentials isnot required in all embodiments of the present invention. For example,if only trusted user electronic devices are able to communicate with theserver then a separate step of authorising the user will not always berequired.

In step 103 of the method, the server transmits an authorisation code tothe garment to activate a sensor of the garment. The authorisation codemay be received by a communication unit of the garment. Theauthorisation code may be transmitted via the user electronic device.That is, the user electronic device may receive the authorisation codefrom the server and transmit the same to the garment.

The server may receive the activity data recorded by the sensor and maytransmit the activity data to the user electronic device. The userelectronic device may directly receive activity data from the server.The activity data transmitted to the user electronic device may not bethe same as the activity data recorded by the sensors. This is becausethe server may perform one or more processing operations on the receivedactivity data.

Referring to FIG. 2, there is shown a method performed by a userelectronic device in communication with a server.

In step 201 of the method, the user electronic device obtains an imageof a garment. The garment comprises a visual symbol located on anoutside surface of the garment. The visual symbol comprises a codestring identifying the garment that is encoded into the visual symbol.

In step 202 of the method, the user electronic device processes theimage to generate a representation of the visual symbol.

In step 203 of the method, the user electronic device transmits therepresentation of the visual symbol to a server so as to activate asensor of the garment identified by the code string to record activitydata.

Referring to FIG. 3A, there is shown an example marker 301 in accordancewith the present invention. The marker 301 in this example is based onthe Vcode® provided by VST Enterprises™ and comprises a visual symbol inthe form of black marks upon white pathways. The black marks representthe characters in the code string. The visual symbol may additionallyencode redundant information for error detection, correction, anduniqueness over different rotations of the marker.

Referring to FIG. 3B, there is shown another example marker 303 inaccordance with the present invention. The marker 303 in this example isderived from the AR marker system known as ARTag. The marker 303comprises a visual symbol in the form of a 6×6 grid of black or whitecells which represent 36 binary ‘0’ or ‘1’ symbols. The 36-bit sequenceencodes the code string and may additionally encode redundantinformation for error detection, correction and uniqueness over thedifferent rotations of the marker.

In both examples, the code string/data string may be retrieved from themarker 301, 303 by processing an image containing the visual symbol. Itwill be appreciated that known image processing operations such ascontour extraction and edge detection will be used to read the symbolfrom the image.

It will be appreciated that the marker 301, 303 in accordance with thepresent invention is not limited to the examples of markers shown inFIGS. 3A and 3B. Instead, other forms of markers 301, 303 that encode acode string identifying the garment into a visual symbol may be used. Inmost preferred examples, the markers 301, 303 are additionally used asfiducial markers 301, 303. This means that the markers 301, 303 act as apoint of reference for the garment and thus enable the position of thegarment and the motion of the garment over time to be monitored simplyby capturing images of the garment. Generally, the marker 301, 303 ispreferred to be a bitonal marker as this means that there is no need toidentify different shades of grey within the marker 301, 303 during theimage processing operation to identify and decode the marker 301, 303.This beneficially helps reduce the sensitive to lighting conditions andcamera settings. Of course, in some examples the marker 301, 303 may notbe bitonal and may comprise different grey levels or indeed differentcolours.

Referring to FIG. 4, there is shown an example garment 41, userelectronic device 43, and server 45 in accordance with aspects of thepresent invention. The garment 41, user electronic device 43, and server45 form an example system 400 in accordance with aspects of theinvention.

The garment 41 in the example of FIG. 4 is in the form of a T-shirt. Thegarment 41 comprises two sensors 401, 403 arranged to monitor theactivity of the wearer of the garment 41. In this example, one of thesensors 401 acts as a monitoring unit and the other sensor 403 acts as areference unit. The sensors 401, 403 are communicatively coupled to acommunication unit 405 arranged to communicate activity data to theserver 45. The garment 41 comprises a marker 407 located on the outsidesurface of the garment 41 and in particular on the main body of theT-shirt. The marker 407 comprises a code string identifying the garmentencoded into a visual symbol as shown in FIGS. 3A and 3B. The marker 407is arranged such that, when imaged by an image capturing device such asthe camera of the user electronic device 43, the marker 407 is useableto generate an authorisation code. The communication unit 405 isarranged to receive the activation code from the server 45/userelectronic device 43. One or both of the sensors 401, 403 are arrangedto be activated to record activity data according to the authorisationcode received by the communication unit 405. Once the sensor 401, 403 isactivated to record activity data, the communication unit 405 mayreceive the activity data from the sensor 401, 403 and transmit the sameto the server 45/user electronic device 43.

The user electronic device 45 in the example of FIG. 4 is in the form ofa mobile phone with an integrated camera. The user electronic device 43comprises a communication unit, a storage, a controller, a display 409,a camera and a user input unit. The controller provides overall controlto the user electronic device. The communication unit transmits andreceives various pieces of information required for communication with aserver under the control of the controller. The communication unittransmits the data string to the server and receives activity data fromthe server. The user input unit receives inputs from the user such as auser credential. The camera captured the image of the garment. Thestorage stores information for the user terminal. The display 409 isarranged to show a live view image of the scene captured by the camera.The display 409 may be a presence-sensitive display and therefore maycomprise the user input unit. The presence-sensitive display may includea display component and a presence-sensitive input component. Thepresence sensitive display may be a touch-screen display arranged toprovide the user interface.

The user electronic device 43 may also include a biometric sensor. Thebiometric sensor may be used to identify a user or users of device basedon unique physiological features. The biometric sensor may be: afingerprint sensor used to capture an image of a users fingerprint; aniris scanner or a retina scanner configured to capture an image of ausers iris or retina; an ECG module used to measure the user's ECG; orthe camera of the user electronic arranged to capture the face of theuser. The biometric sensor may be an internal module of the userelectronic device. The biometric module may be an external (stand-alone)device which may be coupled to the user electronic device by a wired orwireless link.

User electronic devices in accordance with the present invention are notlimited to mobile phones and may take the form of any electronic devicewhich may be used by a user to perform the methods according to aspectsof the present invention. The user electronic device may be a mobileelectronic device such as a smartphone, tablet personal computer (PC),mobile phone, smart phone, video telephone, laptop PC, netbook computer,personal digital assistant (PDA), mobile medical device, camera orwearable device. The wearable device may include a head-mounted devicesuch as an Augmented Reality, Virtual Reality or Mixed Realityhead-mounted device. The user electronic device may be desktop PC,workstations, television apparatus or a projector, e.g. arranged toproject a display onto a surface.

The server 45 may be a single device or may comprise a plurality ofdistributed devices communicatively coupled to one another, e.g. as acloud-based server such as cloud server network. The server comprises acommunication unit, a storage, and a controller. The controller providesoverall control to the server. The communication unit transmits andreceives various pieces of information required for communication with auser electronic device and/or garment under the control of thecontroller. The storage stores information for the server such as codestrings identifying garments and user credential information.

Referring to FIG. 5, there is shown an example user interface 500displayed on the user electronic device 43.

The user interface includes a display of a representation of the wearerof the garment 501. In this example, the representation of the wearer ofthe garment 501 is in the form of a 3D avatar. The 3D avatar will moveas the wearer moves as a result of the motion tracking performed usingthe fiducial markers provided on the garment 41. A more refined motionestimate may be provided by incorporating additional active motionsensors such as accelerometers and gyroscopes into the garment. In otherexamples, the displayed representation of the wearer of the garment 41is in the form of a live view image as captured by the camera of theuser electronic device 43. In this example, the additional active motionsensors are not required for the garment 41 but may still be provided.

The user interface 500 also includes representation of the activity data503 received from the server 45. The representation of the activity data503 in this example is the form of an object 503 that overlays theabdominal muscles of the wearer. The representation of the activity data503 changes colour depending on whether the activity data indicates thatthe abdominal muscles are in contraction or relaxation. In FIG. 5, theabdominal muscles are in contraction and as such the object 503 has adark colour. When the abdominal muscles are in relaxation the colour ofthe object 503 lightens. Of course, other visual representations of theactivity data relating to the abdominal muscles may be provided.

The object 503 is displayed at a position determined according to thelocation of the marker on the garment 41. In particular, the marker is afiducial marker that acts as a reference position for the garment 41 inrelation to the wearer of the garment 41. The position of the object tobe displayed is determined using the position of the marker (x1, y1) inthe image and a predetermined displacement (x2, y2) from the marker to afeature of interest on the wearer such as the abdominal muscles. Inparticular, the position of the object 503 to be displayed can bedetermined as (x1, y1)+(x2, y2).

The user interface 500 of FIG. 5 displays additional activity data forthe wearer and other data for the garment 41 at positions which are notdetermined based on the location of the marker on the garment 41. Theuser interface 500 includes an ECG trace 505 and heartrate data 507; thesignal strength 509 for the communication unit of the garment 41; thebattery level 511 for a battery of the garment 41; GPS coordinate data513; core body temperature and skin surface temperature 515; the oxygenlevel 517, blood pressure and blood glucose levels 519, sleep tracking,step tracking and hydration level 521, and fat level, calories burned,blood lactate level as well as an indication of the type of caloriesburned 523. The user interface 500 also displays warnings 525, 527indicating the wearer's V02 and hydration levels are concerning. Ofcourse, the user interface 500 in FIG. 5 is just one example interfaceand other forms of bio data may be displayed to the user in a differentway.

Referring to FIG. 6, there is shown another example user interface 600displayed on the user electronic device 43. The user interface 600displays a representation of the wearer 601 which may be a 3D avatar ora live view image of the wearer. In addition, the user interface 600overlays the representation of the wearer 601 with two objects 603, 605.The two objects 603, 605 are displayed at positions that correspond tothe location of the pectoral muscle area of the wearer. The position ofthe objects 603, 605 are determined according to the location of themarker on the garment as described above in relation to FIG. 6. Theobjects 603, 605 are representations of the activity data of the wearerrelating to the pectoral muscle area. The objects 603, 605 change colourbased on the received activity data for example to indicate whether themuscles are in contraction or relaxation.

Referring to FIG. 7, there is shown another example user interface 700displayed on the user electronic device 43. The user interface 700displays a representation of the wearer 701 which may be a 3D avatar ora live view image of the wearer. In addition, the user interface 700overlays the representation of the wearer 701 with an object 703. Theobject 703 is displayed at a position that corresponds to the locationof the heart (the representation of the wearer 701 is displayed as amirror image in FIG. 7). The position of the object 703 is determinedaccording to the location of the marker on the garment as describedabove in relation to FIG. 5. The object 703 is a representation of thecardiac activity data of the wearer. The object 703 is in particular ananimated 3D model of a heart that beats at a rate corresponding to theheart rate of the wearer as determined from the activity data.

In addition, the user interface may display information relating to pastor predicted future movements undertaken by the wearer. The garment mayincorporate one or more motion sensors such as accelerometers orgyroscopes which may be used to derive position and velocity data forthe wearer. This information may be displayed such that the user canview how the wearer has moved over time. Moreover, based on past motioninformation a future motion of the user may be estimated and displayed.The motion information may be displayed as a series of points on thedisplay such as in the form of a point cloud.

Referring to FIG. 8, there is shown an example user interface accordingto aspects of the present invention. The user interface displays a liveview image 800 that is captured by a camera communicatively coupled tothe electronic device. The live view image 800 is a live video feed ofthe wearer wearing the garment 41. The garment 41 has a fiducial marker407 located on an outside surface of the garment. The live view image800 is processed to determine the location of the fiducial marker 407.The display of the live view image 800 is augmented with the display ofan augmented reality object 801. The position of the augmented realityobject 801 on the display is determined based on the determined locationof the fiducial marker 407. That is, the augmented reality object 801 isalways displayed at a predetermined displacement from the fiducialmarker 407. The effect of this is that the augmented reality object 801always appears on the display to overlay the cardiac region of thewearer of the garment 41. The augmented reality object 801 provides arepresentation of the cardiac activity data which is recorded by one ormore sensors (not visible) of the garment. The augmented reality object801 comprises a 3D model of the heart 803 that is animated to beat at arate corresponding to the heart rate of the wearer as recorded by thesensor(s) of the garment 41. The 3D model of the heart 803 changescolour based on the heart rate of the wearer. The 3D model of the heart803 is green when the heart rate is at a low value (e.g. less than 100beats per minute), yellow when the heart rate is at a medium value (e.g.between 100 and 145 beats per minute) and red when the heart rate is ata high value (e.g. greater than 145 beats per minute). Of course, othercolours may be used. The 3D model of the heart may additionally orseparately change size, shape or texture depending on the heart rate.The augmented reality object 801 comprises a numerical display of theheart rate 805. The augmented reality object 801 comprises a display ofECG data 807 for the wearer. The display of the heart rate 805 and theECG data 807 may also change colour, size, shape or texture depending onthe heart rate. Conveniently, the present invention conveys cardiacinformation to the observer in a way that is easy and intuitive tounderstand as the augmented reality object 801 is always positioned tooverlay the cardiac region of the wearer.

In summary, there is provided a method of controlling a garment torecord activity data. The method comprises receiving a representation ofa visual symbol, wherein the visual symbol comprises a code stringidentifying the garment that is encoded into the visual symbol 101. Themethod comprises establishing, based on the representation of the visualsymbol, the identity of the garment 102. The method comprisestransmitting, to the identified garment, an authorisation code toactivate a sensor of the garment to record activity data 103.

While the particular examples mentioned above refer to wearable articlesin the form of garments, it will be appreciated that the presentdisclosure is not limited to such examples and other forms of wearablearticle are within the scope of the present disclosure. The wearablearticle may be, for example, any form of electronic device which may beworn by a user such as a smart watch, necklace, bracelet, or glasses.The wearable article may be a textile article.

While the particular examples mentioned above refer to visual symbolslocated on an outside surface of a garment or other form of wearablearticle, it will be appreciated that the present disclosure is notlimited to such examples. Other forms of visual symbol such as thosewhich are readable from the outside of the garment but not necessarilyprovided on the outside surface of the garment are within the scope ofthe present disclosure.

While the particular examples mentioned above refer to methods performedby a server and user electronic device, it be appreciated that thepresent disclosure is not limited to such examples. All of the steps ofthe methods described herein may be performed by an electronic devicesuch as a user electronic device without, necessarily, requiringcommunication with a server. All of the steps of the methods describedherein may be performed by a server without, necessarily, requiringcommunication with a user electronic device.

In some examples according to the present disclosure, electronicscomponents of the garment such as the communication unit and sensor areremovable from the garment. The electronics components may be removablycontained within a pocket of the garment.

The following examples are described to facilitate understanding of theinvention:

-   -   1. A method performed by a server, the method comprising:        -   receiving, from a user electronic device, a representation            of a visual symbol located on an outside surface of a            garment, wherein the visual symbol comprises a code string            identifying the garment that is encoded into the visual            symbol;        -   establishing, based on the representation of the visual            symbol, the identity of the garment;        -   transmitting, to the identified garment, an authorisation            code to activate a sensor of the garment to record activity            data.    -   2. The method of example 1, wherein the representation of the        visual symbol is a data string representing the visual symbol.    -   3. The method of example 1 or example 2, wherein establishing,        based on the data string, the identity of the garment comprises        decoding the data string so as to obtain the code string and        further comprises identifying the garment based on the code        string.    -   4. The method of any of examples 1 to 3, further comprising:        -   receiving, from the user electronic device, a user            credential;        -   establishing, based on the user credential, whether the user            is authorised to activate the sensor; and        -   transmitting the authorisation code to the identified            garment only if the user is authorised to activate the            sensor.    -   5. The method of any of examples 1 to 4, further comprising:        -   receiving the recorded activity data from the garment; and        -   transmitting the activity data to the user electronic            device.    -   6. The method performed by a user electronic device, the method        comprising:        -   obtaining an image of a garment, wherein the garment            comprises a visual symbol located on an outside surface of            the garment, wherein the visual symbol comprises a code            string identifying the garment that is encoded into the            visual symbol;        -   processing the image to generate a representation of the            visual symbol; and transmitting the representation of the            visual symbol to a server so as to activate a sensor of the            garment identified by the code string to record activity            data.    -   7. The method of example 6, wherein the representation of the        visual symbol is a data string representing the visual symbol.    -   8. The method of example 6 or example 7, further comprising        obtaining a user credential from a user, wherein the sensor is        only activated to record activity data if the user is        authorised, based on the obtained user credential, as having        permission to access the activity data.    -   9. The method of example 8, further comprising transmitting the        user credential to a server so that the server is able to        determine if the user is authorised as having permission to        activate the sensor based on the obtained user credential.    -   10. The method of any of examples 6 to 9, further comprising        receiving activity data from the server.    -   11. The method of any of examples 6 to 11, wherein the visual        symbol is part of a fiducial marker located on the outside        surface of the garment, and wherein the method further comprises        processing the image to determine the location of the fiducial        marker.    -   12. The method of example 11, further comprising displaying a        representation of the received activity data on a display.    -   13. The method of example 12, wherein the position of the        representation of the activity data on the display is determined        according to the determined location of the fiducial marker.    -   14. The method of example 12 or 13, further comprising        simultaneously displaying a representation of a wearer of the        garment with the representation of the activity data on the        display.    -   15. The method of example 14, wherein the representation of the        activity data at least partially overlays the displayed        representation of the wearer.    -   16. The method of example 14 or 15, wherein displaying the        representation of the wearer of the garment comprises displaying        the obtained image.    -   17. The method of example 14 or 15, wherein displaying the        representation of the wearer of the garment comprises displaying        an avatar representation of the wearer, optionally wherein the        avatar representation of the wearer is a 3D representation of        the wearer.    -   18. The method of any of examples 14 to 17, wherein the        representation of the activity data is in the form of an        augmented reality object.    -   19. A garment comprising:

a sensor arranged to monitor the activity of the wearer of the garment;

a communication unit arranged to receive activity data for the wearerfrom the sensor and transmit the activity data to an external device;and

at least one marker located on an outside surface of the garment, the atleast one marker comprising a code string identifying the garmentencoded into a visual symbol and arranged such that, when imaged by animage capturing device, the at least one marker is useable to control asensor of the garment identified by the code string to record activitydata.

-   -   20. A method of manufacturing a garment of example 19, the        method comprising:    -   generating a code string using a random number generator;    -   encoding the code string into a visual symbol; and    -   incorporating the visual symbol onto the garment.    -   21. A system comprising a garment of example 19; and one or more        electronic devices operable to:    -   obtain an image of the garment; process the image to generate a        representation of the visual symbol; and    -   transmit the representation of the visual symbol to a server so        as to activate a sensor of the garment identified by the code        string to record activity data.    -   22. A computer program comprising instructions which, when the        program is executed by a computer, cause the computer to carry        out the method of any of examples 1 to 18.

At least some of the example embodiments described herein may beconstructed, partially or wholly, using dedicated special-purposehardware. Terms such as ‘component’, ‘module’ or ‘unit’ used herein mayinclude, but are not limited to, a hardware device, such as circuitry inthe form of discrete or integrated components, a Field Programmable GateArray (FPGA) or Application Specific Integrated Circuit (ASIC), whichperforms certain tasks or provides the associated functionality. In someembodiments, the described elements may be configured to reside on atangible, persistent, addressable storage medium and may be configuredto execute on one or more processors. These functional elements may insome embodiments include, by way of example, components, such assoftware components, object-oriented software components, classcomponents and task components, processes, functions, attributes,procedures, subroutines, segments of program code, drivers, firmware,microcode, circuitry, data, databases, data structures, tables, arrays,and variables. Although the example embodiments have been described withreference to the components, modules and units discussed herein, suchfunctional elements may be combined into fewer elements or separatedinto additional elements. Various combinations of optional features havebeen described herein, and it will be appreciated that describedfeatures may be combined in any suitable combination. In particular, thefeatures of any one example embodiment may be combined with features ofany other embodiment, as appropriate, except where such combinations aremutually exclusive. Throughout this specification, the term “comprising”or “comprises” means including the component(s) specified but not to theexclusion of the presence of others.

Attention is directed to all papers and documents which are filedconcurrently with or previous to this specification in connection withthis application and which are open to public inspection with thisspecification, and the contents of all such papers and documents areincorporated herein by reference.

All of the features disclosed in this specification (including anyaccompanying claims, abstract and drawings), and/or all of the steps ofany method or process so disclosed, may be combined in any combination,except combinations where at least some of such features and/or stepsare mutually exclusive.

Each feature disclosed in this specification (including any accompanyingclaims, abstract and drawings) may be replaced by alternative featuresserving the same, equivalent or similar purpose, unless expressly statedotherwise. Thus, unless expressly stated otherwise, each featuredisclosed is one example only of a generic series of equivalent orsimilar features.

The invention is not restricted to the details of the foregoingembodiment(s). The invention extends to any novel one, or any novelcombination, of the features disclosed in this specification (includingany accompanying claims, abstract and drawings), or to any novel one, orany novel combination, of the steps of any method or process sodisclosed.

1-15. (canceled)
 16. A method performed by a server, the methodcomprising: receiving, from a user electronic device, a representationof a visual symbol located on an outside surface of a garment, whereinthe visual symbol comprises a code string identifying the garment thatis encoded into the visual symbol; establishing, based on therepresentation of the visual symbol, the identity of the garment; andtransmitting, to the identified garment, an authorisation code toactivate a sensor of the garment to record activity data.
 17. The methodof claim 16, wherein the representation of the visual symbol is a datastring representing the visual symbol.
 18. The method of claim 17,wherein establishing, based on the data string, the identity of thegarment comprises decoding the data string so as to obtain the codestring and further comprises identifying the garment based on the codestring.
 19. The method of claim 16, further comprising: receiving, fromthe user electronic device, a user credential; establishing, based onthe user credential, whether the user is authorised to activate thesensor; and transmitting the authorisation code to the identifiedgarment only if the user is authorised to activate the sensor.
 20. Themethod of claim 16, further comprising: receiving the recorded activitydata from the garment; and transmitting the activity data to the userelectronic device.
 21. A method performed by a user electronic device,the method comprising: obtaining an image of a garment, wherein thegarment comprises a visual symbol located on an outside surface of thegarment, wherein the visual symbol comprises a code string identifyingthe garment that is encoded into the visual symbol; processing the imageto generate a representation of the visual symbol; and transmitting therepresentation of the visual symbol to a server so as to activate asensor of the garment identified by the code string to record activitydata.
 22. The method of claim 21, wherein the representation of thevisual symbol is a data string representing the visual symbol.
 23. Themethod of claim 21, further comprising obtaining a user credential froma user, wherein the sensor is only activated to record activity data ifthe user is authorised, based on the obtained user credential, as havingpermission to access the activity data.
 24. The method of claim 23,further comprising transmitting the user credential to a server so thatthe server is able to determine if the user is authorised as havingpermission to activate the sensor based on the obtained user credential.25. The method of claim 21, further comprising receiving activity datafrom the server.
 26. The method of claim 25, wherein the visual symbolis part of a fiducial marker located on the outside surface of thegarment, and wherein the method further comprises processing the imageto determine the location of the fiducial marker.
 27. The method ofclaim 26, further comprising displaying a representation of the receivedactivity data on a display.
 28. The method of claim 27, wherein theposition of the representation of the activity data on the display isdetermined according to the determined location of the fiducial marker.29. The method of claim 27, further comprising simultaneously displayinga representation of a wearer of the garment with the representation ofthe activity data on the display.
 30. The method of claim 29, whereinthe representation of the activity data at least partially overlays thedisplayed representation of the wearer.
 31. A garment comprising: asensor arranged to monitor the activity of a wearer of the garment; acommunication unit arranged to receive activity data for the wearer fromthe sensor and transmit the activity data to an external device; and atleast one marker, the at least one marker comprising a code stringidentifying the garment encoded into a visual symbol and arranged suchthat, when imaged by an image capturing device, the at least one markeris useable to control a sensor of the garment identified by the codestring to record activity data, wherein the communication unit isarranged to receive an authorisation code, the authorisation code beinggenerated according to the at least one marker, and wherein the sensoris arranged to be activated to record activity data according to theauthorisation code received by the communication unit.
 32. The garmentof claim 31, wherein the communication unit is arranged to receiveactivity data for the wearer from the sensor and transmit the activitydata to an external device.
 33. The garment of claim 31, wherein the atleast one marker is a fiducial marker.
 34. The garment of claim 31,wherein the sensor is able to record a plurality of different types ofactivity data, and wherein the sensor is arranged to be activated torecord all or a subset of the types of activity data according to thereceived authorisation code.
 35. The garment of claim 31, wherein thegarment comprises a plurality of sensors, and one or more of the sensorsare activated according to the authorisation code received by thecommunication unit.